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METHOD AND APPARATUS FOR PLAYING 
MULTIMEDIA AUDIO-VISUAL PRESENTATIONS 

RELATED APPLICATIONS: This application claims priority to provisional application 
S.N. 60/267,336 filed February 8, 2001 entitled METHOD AND APPARATUS FOR 
EXTRACTING AND STORING SONGS FROM MULTIMEDIA PRESENTATIONS, 
incorporated herein by reference. 



BACKGROUND OF THE INVENTION 
^ A. Field of Invention 

H This invention pertains to a method and apparatus for retrieving and storing the 

]| audio portion of multimedia programs. More particularly, this invention pertains to a 
p method and apparatus in which a multimedia program that may be optionally 
Q compressed is received and can be selectively played or used to generate a separate 

ill 

Gj audio program that is saved as an audio file. The audio file can be replayed on a 

yy 

0 suitable device or transmitted electronically to another location. 
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B. Description of the Prior Art 

Typically, programs depicting musical events are distributed to the public using 
one or more formats, such as multimedia formats (including an audio and a video 
component), multi-channel audio formats (e.g., 5.1 or six-channel) and stereo (or two- 
channel) formats. The customer can then replay the programs using an appropriate 
device. 
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The programs may be distributed either directly through a distributed computer 
network, such as the Internet, and/or indirectly, i.e., by recording the program on 
appropriate media. For example, programs in multimedia formats (unless otherwise 
noted, the term 'multimedia programs' and 'multimedia output signals refer to programs 
or signals that include a multi-channel audio track with or without a video track) are 
recorded on CDs, DVDs, video tapes and so. Programs in stereo formats are 
recorded either as analog signals, using for instance magnetic tapes, or digitally on 
flash memory cards, as well as CDs or other similar storage means. Of course, a 
multimedia program contains much more information then a stereo program. 
[J A problem with the existing distribution means is that they are expensive for the 

y producer if a program is made available in multiple formats. Existing distribution means 
[fl are also disadvantageous for customers who often buy multiple devices suitable for 
N* playing programs in different formats. 

O Moreover, while devices, such as digital portable devices, exist that can be used 

ru 

to store and replay digital audio files. However, these devices cannot be used for 
pj multimedia programs directly because multimedia programs are inherently large and 
hence it is impractical to store directly them on a digital portable device. Moreover, 
multimedia programs are drastically compressed using high-level compression 
protocols, such as MPEG4, and digital portable devices do not have the computational 
power required to decompress these programs. 
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OBJECTIVES AND SUMMARY OF THE INVENTION 

An objective of the present invention is to provide an apparatus that can be used 
to convert a multimedia program into a multimedia output signal suitable to be shown on 
a multimedia player, and also to obtain a corresponding output audio signal that can be 
stored and replayed on an audio device. 

A further objective is to provide an apparatus that can generate from a 
multimedia program an audio signal that can be stored and replayed at will 
independently of the original program. 

A further objective is to provide an apparatus of the kind described above that 
can be implemented easily and inexpensively. 

Other objectives and advantages of the invention will become apparent from the 
following description. 

Briefly, in a preferred embodiment the apparatus constructed in accordance with 
this invention includes an input port used to receive a multimedia program; a separator 
coupled to the input port and adapted to selectively generate corresponding multimedia 
output signals from said multimedia program, and an audio output stage adapted to 
generate an audio output signal. 

Preferably, the input port is adapted to receive a broadband multimedia program 
but, alternatively, it may include a media reader such as a DVD or a CD reader. 

In one embodiment, the separator is adapted to generate multimedia signals 
including an audio and a video component. In an alternate embodiment, the separator 
generates a multichannel audio signal, i.e., without a video component. 



The audio output stage preferably includes a folder circuit adapted to fold the 
multichannel audio signal into a stereo channel audio signal. The output stage includes 
a compressor that compressor the stereo channel audio signal into a compressed digital 
output signal, using a standard protocol such as MPEG or ATRAC. 

The digital output signal can be transmitted via a standard data bus, such as a 
serial, parallel or USB bus, to an audible device, such as a portable digital device and 
stored in its solid state memory. The customer can then replay the stored audio signal 
at will. 

The audio program can also be replayed on any home stereo system. 
Mj Alternatively, the audio program is transmitted through the Internet or other means to 
O another customer. 

j| The multimedia program could include various control and data signals, including 

p information related to the program, its contents, the recording artist, the location of the 

q recording, and so on. This information can be incorporated into the output audio signal 

IV 

□ stored on the portable digital device and shown selectively to the customer. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a general block diagram of an apparatus constructed in accordance with 
this invention; 

Fig. 2A shows somewhat diagrammatically the contents of a typical multimedia 
program; 

Fig. 2B shows somewhat diagrammatically the multimedia output signal 
generated by the apparatus of Fig. 1 ; 



Fig. 2C shows somewhat diagrammatically the audio output signal generated by 
the apparatus of Fig. 1 for an audio device; 

Fig. 3 shows a block diagram showing the components for an embodiment of the 
apparatus of Fig. 1 wherein multimedia programs are received via a broadband portal; 

Fig. 4 shows a block diagram showing the components for another embodiment 
of the apparatus of Fig. 1 wherein multimedia programs are read from a DVD; and 

Fig. 5 shows a block diagram showing the components for one embodiment of 
the apparatus of Fig. 1 wherein multimedia programs are read from a CD. 

£ DETAILED DESCRIPTION OF THE INVENTION 

q Referring now to Fig. 1 , an apparatus 10 is shown including a storage/separator 

j| member 12 and a selection controller 14. The apparatus 10 is adapted to receive 

ill multimedia programs either directly, from the Internet, or indirectly, from a recorded 

O medium, as described in more detail below. The multimedia program may be encoded 

O using a standard protocol. 

.SSSS. 

JjJ Typically, as shown in Fig. 2A, the multimedia program includes a video track, a 

respective audio track, program information describing the program or programs, 
including, for instance, the names of the artists, the place where the program was 
recorded and other information that may be of interest to a customer. If the program 
includes several selections, then timing signals may also be included that define where 
each selection begins and/or ends. Typically, all these tracks and information are 
compressed and encoded so that an individual component cannot be simply partitioned 
from the program, but instead the whole program must be decompressed and decoded. 
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However, one skilled in the art will appreciate that the invention is also applicable to 
uncompressed and/or uncoded programs 

The customer provides commands through the selection control 14 to define 
what programs to receive and play. The storage/separator member 12 receives and 
stores the multimedia program, and then, in response to the commands from the 
costomer, it converts the multimedia program into a sequential multimedia output signal 
suitable for display to the customer by the multimedia player 16. The player 16 may 
include, for example, a screen and a plurality of speakers (not shown) arranged and 
constructed to play the video and audio tracks synchronously. This multimedia output 
signal is shown somewhat diagrammatically in Fig. 2B. 

Importantly, the converter/separator 12 is also adapted to selectively process the 
received multimedia program and generate a strictly audio output signal. As shown in 
Fig. 2C, this audio output signal includes an audio track, preferably a stereo rendition of 
the multichannel audio track. If the multimedia program includes several sequential 
segments, then the customer may elect to obtain a stereo audio track for only some of 
the segments. 

Moreover, the audio output signal can also include at least some information 
associated with the programs or the individual program segments selected by the 
customer. 

The audio output signal is received by an audio device 18 which is adapted to 
store the output audio signal and to selectively play the same as desired by a customer. 
In one embodiment, the device 18 is a digital device with a flash card memory, adapted 
to store and retrieve digital data and convert the same into corresponding audio 
signals. 



Referring now to Fig. 3, in a preferred embodiment of the invention, apparatus 
1 0A is a set-top box such as a personal video recorder adapted to receive a multimedia 
program in the form of a streaming broadband transmission over the Internet. This 
streaming transmission may be a standard transmission using push technology, or may 
be 'on demand' in the sense that it is transmitted in response to a selection by the 
customer. Alternatively, for the purposes of this invention, the multimedia program may 
also be transmitted as a data file, rather than by streaming. 

In any event, prior to transmission, the multimedia program is compressed using 
a standard compression protocol such as MPEG-4, or any other similar formats. 
Mj Apparatus 1 0A includes a broadband or other type of multimedia input port 20 for 

;3 receiving the multimedia program. The received multimedia program is stored in a RAM 
!5 22. 

w 

A customer can elect to play the stored multimedia program at any time, by 
Q operating selection controM4A. In response, the program is retrieved from RAM 22. It 
□ is then decompressed and decoded by separator circuit 24 and the resulting multimedia 
| output signal is sent to the multimedia output port 26. From this port, the multimedia 
signal is then fed to an appropriate multimedia player, as discussed above in 
conjunction with Fig. 1 . 

In addition, the customer can also request a stereo output signal from the 
multimedia program. This stereo output signal can be generated concurrently with the 
multimedia output signal, or can be generated completely independently. 

When a request for a stereo output signal is received, the separator 24 retrieves 
the multimedia program from RAM 22 (unless it was retrieved earlier), decompresses 
and decodes it (if necessary), and separates a multichannel audio signal therefrom. 
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This multichannel audio signal is fed to an audio output stage including a folder circuit 
30, an encoder 32 and an audio output port 34. The folder circuit 30 folds the 
multichannel (for example, 5.1 or six-channel) audio signal into a corresponding stereo 
audio signal. Algorithms for this operation are well known in the art. 

The resulting stereo audio signal is fed to the audio encoder 32 which encodes 
and compresses it into a corresponding digital audio signal, using a known compression 
protocol such as MPEG (e.g., MP3) or ATRAC. The resulting audio output signal is 
sent to the audio output port 34. The output port 34 may be a serial data port, a parallel 
data port, or preferably a USB port. 

M- The audio output signal is then preferably stored by the customer on a suitable 

w 

w device for future replay. For example, digital portable audio devices are now available 

jjj which can be used to store audio signals in the form of digital files, and then replay the 

ui 

^ audio signals at will. These devices (made by many companies, such as Samsung, 

Is 

0 RCA, Casio, Diamond, etc.) are portable battery-operated devices that can be taken by 

ftl 

Q customers anywhere and used to play audio selections, in the same manner that audio 

S3 selections are played from CDs or magnetic tapes. 

j y ■ 

As shown in Fig. 3, typically such an audio device 40 includes an audio port 42, 
a controller 44 and a data storage element, such as a RAM 46. The audio port can be a 
standard data port such as a serial data port, a parallel data port, or a USB port. The 
RAM can be, for example, a digital flash card. 

The digital output audio signal received from the audio port 42 is stored in the 
RAM 46. 

The device 40 is also provided with means for receiving commands from a 
customer, such as switches 47. The switches 47 are connected to the controller 44. 
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When a customer requests an audio signal(or a selection from an audio signal) 
stored in RAM 46, the corresponding data is transferred to a decoder 48. The decoder 
48 decodes and decompresses the data into a digital signal and sends it to an analog- 
to-digital converter (ADC) 50. The ADC 50 converts the digital signal into a 
corresponding analog signal. The analog signal is sent to an analog output such as a 
headphone jack 52. The customer can then listen to the selected audio signal through 
speakers or headphones 54. 

As shown in Fig, 2A, the multimedia program includes not only the audio and 
visual tracks, but also various control signals, timing signals and other program 
information. The audio encoder 32 is configured so that it also receives some of this 
program information and incorporates it into the audio signal, as shown in Fig. 2C. 

If device 42 is equipped with a visual display 56, then the controller 44 shows on 
display 56 the program information associated with the audio signals stored in RAM 46 
or selected by the customer. 

Fig. 4 shows an alternate embodiment of the invention. In this embodiment, 
apparatus 10B is adapted to receive multimedia programs that have been pre-recorded 
on an appropriate medium such as a DVD. In the apparatus 10B the multimedia input 
port includes a DVD reader 20A used to receive and read a DVD 21 . The multimedia 
program is recorded on DVD in a compressed format using an appropriate DVD 
protocol. In other words, in this embodiment, apparatus 1 0B is a modified DVD player. 



Once a DVD 21 is inserted into the DVD reader 20A, the reader 20A reads the 
a from the DVD 21 and transfers it into a buffer 22A. Separator 24 decompresses 
data and separates into a corresponding multimedia output signal that is then 



transmitted to the multimedia output port 26. 

In addition, the apparatus 10B can also be used to generate from the multimedia 
program recorded on DVD 21 a corresponding audio output signal in a manner similar 
to the set top apparatus 10A, discussed above. The main difference between the two 
apparatuses is that the separator 24A has to decode and decompress the data using 
DVD standards. 

Audio-only multimedia programs are also distributed that include a multichannel 
audio track but without the video track. These programs can also be distributed directly 
^ or recorded on a medium such as a CD or a DVD. From a customer's point of view, 
g these programs have the same disadvantages as the multimedia programs with video 
components: they cannot be played on a portable audio player. 

! ft 

y The embodiment of Fig. 5 shows how the present invention can be used to 

istsss 

^ remedy this problem as well. In Fig. 5, an apparatus 1 0C is shown that is used to 
!Jj generate a multichannel (such as 5.1 channel) output. The apparatus 10C includes a 
w CD reader 20B that is used to read the multimedia program on a CD 21 A. The 
apparatus 10C operates in the same manner as the apparatus 10B in Fig. 4, except 
that the multimedia output port 26A generates only a multichannel audio output rather 
than a multimedia output. Of course, the apparatus of Fig. 4 may be used to generate 
only multichannel audio output as well. 

In the embodiments described above, the apparatuses 10, 10A, 10B are 
constructed to generate both a multimedia output signal and a multichannel audio 
signal. An output audio stage is then used to generate the output audio signal. Thus, 
the apparatus can be easily implemented by adding the output audio stage to existing 
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devices. Alternatively, the apparatus 10, 10A, 10B can be configured to generate only 
the output stereo signal, in which case the multimedia output port can be omitted and 
the operation of the separator can be simplified. 



In the embodiments described above, the output audio port 34 is connected to a 
portable digital player 40. Alternatively, the audio port 34 can be connected to a 
recording device (not shown) that can be used to record the output audio signals on a 
suitable medium. For example, the audio port 34 could be connected to a CD burner 



that records the output audio signals on a CD, including a miniature CD (or MD). 

In general, the audio port 34 could be connected to any device suitable to play 
£ audio programs. Alternatively, the signals from audio port 34 could be transmitted 

.past. 

Jj electronically to other customers via the Internet, or by other means. 

rU 

IH Finally, an ADC (not shown) may be incorporated into the apparatus 1 0A and 

j* used to generate analog instead of digital output signals. These analog signals can 

Q then be recorded by a standard tape recorder on magnetic tape. 

I U 
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w Numerous other modifications may be made to the invention without departing 

from its scope as defined in the appended claims. 
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